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INTRODUCTION 



I . 

As we are reminded on an all too frequent basis, weapons 
systems acquisitions by the Department of Defense (DoD) have 
been plagued by a series of cost overruns. With the current 
political climate of intense scrutiny of government 
expenditures in an effort to shrink the federal budget and 
battle record deficits, the DoD can ill afford any such 
adverse publicity. Some of the implications of continued 

deficient cost estimation are particularly disturbing. 
Using pessimistic cost estimates that encompass all 
uncertainty will minimize the chance of a cost overun by 
providing cost estimates that are consistently too high. 
Of real concern is the possibility that these unnecessarily 
high estimates might become self-fulfilling prophecies. 
Such cost estimates might also prompt a decision to invest 
in an alternative system that is less costly but also less 
cost ef f ect ive--the end result would be an inefficient 
allocation of valuable economic resources. At the other 
extreme, a cost estimate that is too low can lead to 
insufficient funding which, if not supplemented, could delay 
deliveries of needed weapons or prematurely terminate 
production at output quantities that are less than optimal. 
Another effect, with possibly more serious consequences, is 
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the possible erosion of public trust in our military forces 
if the public perceives mismanagement and waste are 
perceived to be the source of cost overruns. 

Some of our cost estimation difficulties stem from 
design changes or improvements that occur after a cost 
analyst has formulated an estimate of a program's cost. 
Such problems are beyond the analyst's control; 



unfortunately, cost 


estimation problems have occurred in 


many programs that 


didn't experience such changes. A 


possible conclusion 


is that our current cost estimation 



methodology is inadequate and that a better understanding of 
the factors that determine cost is required. 

Current methods of cost estimation can be divided into 
two approaches: (1) the "topdown" or statistical approach 
which generates simple, imprecise estimates based on 
existing similar systems and which is insensitive to many 
production decisions and (2) the "bottom up" or industrial 
engineering approach which examines separate segments of 



work in great detail 


and synthesizes these estimates into a 


complex, yet often 


imprecise, total cost estimate which 


requires substantial 


revision when changes occur . Neither 


of these approaches 


is particularly helpful to a program 



manager who must develop a funding profile suitable for 
projected lot release dates and delivery schedules and then 
deal with subsequent changes in funding or production 
schedule . 
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This paper concentrates on a model developed principally 
by Gulledge and Womer [Ref. 1] that strives to model the 
factors influencing the cost of airframe production. In 
particular, the influences of production rate and delivery 
schedule, as well as the standard learning effects, are 
thought to significantly affect program costs. These 
factors, together with basic economic theory, are 
incorporated into a model which aspires to encourage wiser 
acquisition policy by providing greater sensitivity to 
alternative policy decisions. The chapters that follow will 
provide a historical perspective of cost estimation 
methodology, review the proposed model, evaluate its 
performance using data on F-4B airframes purchased by the 
Navy, and investigate the model's applications. 
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II. HISTORICAL PERSPECTIVE 



The DoD has historically favored a relatively simple 
parametric approach to cost estimation. Costs are modeled 
as a function of only a few aircraft design and performance 
characteristics and unit costs are expected to decrease as 
learning accumulates with production experience. The model 
considered in this paper is unique in that it attempts to 
model the effects of production rates as well as learning 
and, implicitly, the effects of facility size on total 
program costs. Thus, it is an integration of what have 

generally been two distinct approaches to cost estimation: 

(1) the neoclassical economic approach which purports 
production rate to be a significant determin'ant of cost and 

(2) engineering cost studies which rely heavily on the 
learning curve to relate costs to the number of items 
produced but not to the rate at which they are produced. 

Economic theory typically depicts the relationship 
between unit production costs and output per production 
period as a U-shaped function. Such a shape indicates that, 
as the level of output increases, unit costs fall over a 
certain range and then begin to rise. This reflects the 
powerful logic of the law of diminishing returns which, as 
explained by Samuelson [Ref. 2], says 
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An increase in some inputs relative to other fixed inputs 
will, in a given state of technology, cause total output 
to increase; but after a point the extra output resulting 
from the same additions of extra inputs is likely to 

become less and less. This falling off of extra returns 

is a consequence of the fact that new "doses" of the 
varying resources have less and less of the fixed 

resources to work with. 

Johnston (Ref. 3] cites the concept of diminishing marginal 
product as one of the most common generalizations of the law 
of diminishing returns. Diminishing marginal product refers 
to the eventual decreasing increments in output that occur 

when the quantity of an input is increased by equal 

increments, with all other input quantities remaining fixed. 
A tendency for varying factors to show diminishing returns 
when applied to fixed factors implies a tendency for 
marginal cost to be rising. If at first there are 
increasing returns, there are also declining marginal 
costs--but ultimately diminishing returns and increasing 
marginal cost will prevail. Such a formulation is consis- 
tent with the notion that, for a firm operating in perfectly 
competitive product and factor markets, marginal cost at 
equilibrium must be rising. 

The implication of diminishing returns for an airframe 
cost model is reasonably clear. An increase in production 
rate will, at least in the short term, require additional 



labor . 


Since 


the production 


facility itself must 


be 


considered fixed 


, consider two 


alternatives 


proposed 


by 


Washburn 


[ Ref . 


4] that could 


be used to 


i ncrease 


the 
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production rate: (1) overtime or weekend work where a 

premium is paid for labor at odd hours; or (2) hiring 
additional manpower at a loss of efficiency due to crowding, 
scheduling, etc. Economic theory thus leads us to the 
conclusion that production rate and production costs are 
positively related; that is, with higher production rates, 
labor is more costly and/or less efficient, and, as a 
consequence, costs per unit of output increase. While 
firmly grounded in economic theory, this conclusion has 
suffered from a lack of empirical verification. 

In contrast to the neoclassical approach is the 
engineering cost study technique which incorporates the 
progress function or learning curve concept developed by 
Wright [Ref. 5]. In his pioneering analysis of aircraft 

production costs, Wright noted that labor hours per unit of 
output decreased as cumulative output increased and proposed 
the function F = (F is a factor of cost variation 

proportional to N, the quantity produced; X is a learning 
parameter) to explain the labor cost-production quantity 
relationship. Wright's data were consistent with the eighty 
percent learning curve which has received widespread 
acceptance as an industry "standard". As explained by 
Wright, greater production improves worker efficiency and 
makes additional tooling economically feasible so that a 
firm incurs only an eighty percent increase in labor costs 
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when output is doubled. It should be noted that Wright's 
research and the factors derived assumed that no major 
changes would be introduced during production. 

It is readily apparent that production rate and pro- 
duction quantity are positively correlated so it seems that 
these two approaches to cost estimation are contradictory. 
The first hypothesizes that unit production costs are 
directly related to the rate of production while the second 
hypothesizes that unit production costs are inversely 
related to the cumulative volume of production which, in 
turn, is directly related to the rate of production. 
Further complicating the puzzle is that the first approach 
is based on solid, wel 1- accepted economic theory with little 
empirical support while the other is seemingly adopted to 
explain the data and has little theoretical underpinnings. 

Numerous research efforts have been undertaken to 
investigate the ambiguity of the cost/quantity/rate 
relationship. In Asher's [Ref. 6] study of cost-quantity 
relationships in airframe production, he concluded that the 
conventional learning curve may not be an entirely accurate 
description of the relationship between unit cost and 
cumulative output. For certain values of cumulative output, 
he found that the labor cost curve became convex which would 
be consistent with the diminishing returns expected by the 
economist's approach. 
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In subsequent research, Alchian [Ref. 7] reformulated 
the traditional cost function to explain much of this 
apparent contradiction. While acknowledging that all of the 
characteristics of a production operation can affect its 
cost, Alchian directs attention to x(t)--the rate of output, 
V--the total contemplated volume of output, T--the first 
scheduled delivery date, and m — the time interval between 
the first and last scheduled deliveries. These four 
characteristics comprise the input variables for the Alchian 
cost function, C = f (V,x,T,m) . On this function are based 
Alchian' s nine propositions to explain the cost-quantity 
relationship. All other factors being fixed, Alchian 
contends that: (1) 3C/3x(t) > 0, cost varies directly with 

production rate; (2) 3 C/ 3 x > 0, the increment in cost is 

an increasing function of production rate; '(3) 3c/3v > 0, 

cost varies directly with the total anticipated volume of 
outpUT; (4) 3 C/3V < 0, the increment in cost is a decreas- 
ing function of total volume; (5) 3(C/V)/3V < 0, cost per 

2 

unit decreases as total volume increases; (6) 3 V/aV3x < 0, 

marginal discounted cost of increased quantity of output 
decreases as production rate increases; (7) 3C/3T < 0, cost 

varies inversely with the elapsed time until first delivery; 

(8) all derivatives in propositions 1-5 are diminishing 
functions of T, but not all diminish at the same rate; and 

(9) the cost of future output declines as the total quantity 
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produced increases. Propositions 1, 2, 3, 7 can be said to 

encompass the notion of diminishing returns put forth by the 
conventional economic approach while propositions 4, 5, 6, 9 
support the learning curve notion of decreasing unit costs 
as total volume increases. Even without the learning 
effect, Alchian felt that 8C/3V would be decreasing. This 
second type of cost saving depends on scheduling larger 
volumes of production in advance which may allow a reduction 
in capital cost or operating costs per unit. 

As further explained by Hirshleifer [Ref. 8], the key 
idea is that cost can be regarded as a function of the 
quantity of output in two different dimensions; the rate of 
output and the scheduled volume of output. The first of 
these is a flow measure while the second is a stock measure 
and, as pointed out by Alchian [Ref. 7], the response of 
cost to changes in the one direction is qualitatively 
different from the response to changes in the other 
dimension of output. Thus, marginal cost can always be a 
rising function of the rate of output, volume held constant, 
and a falling function of output volume, rate being held 
constant, and neither of the aforementioned theories of cost 
estimation is contradicted. 

In their research of Alchian' s proposals, Preston and 
Keachie [Ref. 9] contrasted the U or L-shaped curve 
typically used in economic analysis to depict the unit cost- 
production rate relationship with the hyperbolic learning 
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curve that models unit costs as a continuously decreasing 
function of total output. The learning curve approach was 
discredited for ignoring the effects of production rate. 
They felt the production rate could not be assumed constant 
nor could it be considered an immaterial factor of unit 
costs. Their suggested integration of the economist's cost 
function and the learning curve involves three variables: 
C^, the level of production costs for a production period; 
q^, the amount of output per production period; and V, the 
accumulated level of output. Their cost function can be 
displayed graphically as 




Figure 1. Integrated Cost Function 
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The U-shaped curve shows the combined effects of the 
spreading of fixed costs and the gradual rising rate of 
variable costs, while the downward slope with respect to V 
shows the learning effect. 

Using a similar approach, Cox and Gansler [Ref. 10] 
noted that a move from a relatively inefficient to one 

near the optimum results in more rapid cost decreases than 
would have resulted from a standard cost improvement curve. 
Conversely, a move from an efficient near the optimum to 
a less efficient rate some distance from the optimum results 
in a reduced rate of cost improvement from what we would 
expect from a standard cost improvement curve. A cost 
increase could, and would, result if the new production rate 
is significantly different from the previous, more efficient 
rate. 

As is becoming apparent, the interrelationship of 
production rate and the total volume of output is quite 
complicated and difficult to unravel. Alchian's postulates 
are theoretically sound but empirically unvalidated due to 
the nature of cost data and the complexity of the rela- 
tionship. For example, when both volume and rate of output 
change in the same direction, Alchian's postulates are 
inconclusive — the two expected effects work in opposite 
directions and the net result cannot be reliably predicted. 
It has also been shown that both the magnitude and direction 
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of change in unit cost depend upon the extent of movement 
toward or away from the optimal production rate when a rate 
change -is required. 

Considering the intricacy of this cost-quantity-rate 
relationship, it is not surprising that several studies have 
found contradictory results. Large et . al. [Ref. 11] were 
forced to conclude that the influence of production rate 
could not be predicted with confidence and could probably be 
ignored since other uncertainties prevailed. Their analysis 
found that rate effects were often negligible and sometimes 
contrary to the a priori notion that production rate and 
unit costs were inversely related. They also noted that 
high volume, high production rate programs were not typical 
of recent DoD aircraft procur ements--of the 29 acquisition 
programs they surveyed, 18 had production runs of less than 
500 and only eight had production runs of greater than 1000. 
This provides empirical evidence that production facilities 
are typically not built to sustain high production rates and 
lends credence to Washburn’s previously cited contention 
that raising the production rate requires hiring additional 
labor at a premium since the production facility itself is 



Research by Smith [Ref. 12] and later by Congleton and 
Kinton [Ref. 13] used the cost function 



fixed 



B 



1 




Cost = 



( 1 . 1 ) 
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cost of first unit 



where 



X, 



cumulative quantity produced 
slope of quantity/cost curve 
rate of production 
slope of rate/cost curve 



and found unit costs to be significantly and negatively 
correlated with production rate. Bemis [Ref. 14] obtained 
similar results with his model for examining the effects of 
production rate on the cost of many defense items. Cox and 
Gansler's [Ref. 10] study of tactical missile programs found 
both positive and negative correlation of unit costs with 
production rate. 

Womer [Ref. 15] postulates that analyses such as these 
that conclude that unit costs decrease as the rate of 
production increases (i.e., increasing returns to scale) are 
inconsistent with or ignore optimal contractor behavior. As 
noted by Washburn [Ref. 4], consistently increasing or even 
proportional returns to scale would, in the presence of 
discounting, lead to an optimal production program that 
crowds all production into an arbitrarily short period at 
the very end. 

In a model which predates the one considered in this 
thesis, Womer [Ref. 15] incorporates the research of both 
Alchian [Ref. 7] and Washburn [Ref. 4] into a production 
function that relates the rate of resource use and 
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cumulative production experience to the output rate while 



being consistent with logical contractor behavior. The 
following production function is specified: 



q(t) = AQ^ (t) (t) 



( 1 . 2 ) 



where q(t) = output rate at t 



Q(t) = cumulative output at t 



x(t) = rate of variable resource use at t 



5 



learning parameter; 0 < 5 < 1 



Y 



returns to scale parameter; y > 1 



A 



a constant, A > 0 



By restricting y to values greater than one, it is assumed 
that diminishing returns exist for the variable resource 
which insures that the model makes economic sense. It is 
this key assumption that distinguishes Womer's model from 
most others. Solving this production function for x(t) and 
integrating over time yields the amount of the variable 
resource used during the time period in question. This 
quantity is used as the dependent variable in the model 
formulated by Gulledge and Womer [Ref. 1] . It is this 
model, which seeks to combine the economist's theories on 
production rate effects with the learning effects of 
cumulative production, that the remainder of this paper is 
devoted to . 
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III. 



THE MODEL 



The model considered in this thesis was developed by 
Gulledge and Womer [Ref. 1] in an effort to provide a 
sensible explanation of the joint effects of learning and 
production rate on airframe production costs. It was their 
perception that existing models were extremely limited by an 
inability to consider production policy changes which often 
occur prior to or during the course of a production program. 
Such static models could be of only limited use to a program 
manager forced to contend with changes in funding and/or 
production schedules. The thrust of their research was 
therefore to provide a model capable of capturing the rela- 
tionship between total program cost and both' endogenous and 
exogenous production rate changes that inevitably occur in 
the course of a production period. Much of the ensuing 
description and derivation of the model is extracted from 
Gulledge and Womer' s [Ref. 16] explanation of their revised 
model . 

Womer and Gulledge identified four means by which 
production scheduling might affect production efficiency 
and, therefore, cost. The first production cost driver is 
the usual concept of learning by doing. To help explain 
this effect and the production cost drivers, Washburn's 
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[Ref. 4] concept of a production line is incorporated as a 
frame of reference. Learning by doing affects costs by 



affecting 


the efficiency of 


each 


position 


along 


the 


production 


line. 


That is, as 


the 


cumulative 


number 


of 


airframes 


pass i ng 


each position 


increases, experience 


and 


efficiency 


at the 


position increase 


and unit costs (or 


at 



least labor hours) will decrease. This process implies that 
at any point in time the experience on the production line 
could vary significantly. 

The second production cost driver is a different 
learning effect. With the passage of time, learning may 
occur as a result of events other than experience at a 
position on the production line. For example, labor hours 
may be devoted specifically to improving or refining the 
technique of a particular work station in the early stages 
of a production program. Later in the program, this may 
result in increased efficiency independent of experience at 
a given point on the line. Positions at the end of the line 
may work more efficiently on the s ame airframe than 
positions at the beginning of the line. This effect might 
also arise from experience at other locations on the 
production line. In this case, positions late in the 
production line benefit from the experience of earlier 
positions and work at these later positions is accomplished 
more efficiently. 
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A third production cost driver is the speed of the 
production line. Unless compensated by learning, an 
increase in the speed of the line is expected to require 
more labor at each position on the line. Due to the 
presence of diminishing returns, such increases in labor are 
expected to be more than proportional to the increase in 
speed . 

The fourth cost driver is the length of the production 
line. One means of boosting the delivery rate is to 
increase the number of positions along the production line. 
This reduces the workload per position and increases the 
total amount of work done per unit of time. If alternative 
length production lines were allowed at the start of pro- 
duction, this driver may not affect unit costs. However, if 
the length of the line is changed on shoft notice, unit 
costs can be adversely affected by crowded facilities and 
overused tools that hamper production efficiency. 

By augmenting a classical homogeneous production 
function with a learning hypothesis, the model now to be 
described attempts to capture the above four effects in an 
estimable and analytic manner. By minimizing the discounted 
cost of production subject to a production function 
constraint, the model's output is the optimal time path of 
resource use. Since relative factor prices are assumed 
constant over the relevant time period, costs are measured 
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in units of labor, the variable resource. Variables used in 
the analysis are: 



i = 


the sequence number of an airframe, i = l,2,...,n 


V 


the average number of airframes in process 


^si 


the date work begins on airframe i; work on all 
airframes from the same lot is assumed to start on 
the lot release date. 


^di 


the delivery date for airframe i 


qi(t) = 


the production rate at time t on airframe i 


o 

rt 

II 


the cumulative work performed on airframe i at 
t ime t , i .e . , 


x.(t) = 


t 

Qi(t) = f q(x)dT 

t . 

S 1 

the rate of resource use at time t on airframe i 


6 


a parameter describing learning prior to 
airframe i 


e = 


a parameter describing learning on airframe i 


Y 


a parameter describing returns to the variable 
resources 


a = 


a parameter associated with decreases in 
productivity as an airframe nears completion 


V = 


a parameter describing returns to the length of 
the production line 


P = 


the discount rate 


c. 

1 


discounted variable cost of a single airframe 



The production function is assumed to be of the 
following form; 

q.(t) = A(i - 1/2)^ Qi^(t) (t^. - t)“ x.^/^(t) V'’ (3.1) 
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where A is a constant. The input x is assumed to be a 
composite of many inputs whose rate is variable throughout 
the production period. 

This production function is a relatively simple function 
based upon the four previously mentioned production cost 
drivers which are combined so as to conform with economic 
theory and the empirically observed learning phenomenon. 
When analyzing each term of the function individually, the 
term (i - 1/2) describes learning by doing in the produc- 
tion of the ith airframe. The terms Q^^(t) and - t) ^ 
attempt to describe the effects of learning over time. It 
should be noted that as the delivery date is approached, it 
is assumed that labor becomes more difficult to substitute 

for time in the productive process so it is anticipated that 

1 /y 

both e and o will be between 0 and 1. Thre term (t) 
captures the effect of production rate with Y expected to be 
greater than 1 and thus consistent with diminishing returns 
to the variable resource. Finally, the term attempts to 
capture the effect of the length of the production line. It 
is assumed that more airframes in the same facility lessens 
efficiency so that v should be negative and small. 

Assuming a contract written to induce a firm to minimize 
its discounted costs of production, the problem may be 
stated as: 
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^di 



Minimize C 



/ U ± 

‘=1 'si 



(t) e 



(3.2) 



subject to: 



1) 


ct 

II 


A(i 


2) 




= 1 


3) 




= 0 



6^ e 



“ i/y / i. \ tr'’ 



1 1/2/. ../H 



since the total cost of production is monotone nondecreasing 
and the subproblems are additive/ the solution can be 
obtained by minimizing each of the subproblems. The 
representative problem for the ith airframe may thus be 
stated as: 



^:di 



Minimize C 



. = J X. (t) e ^^dt 



(3.3) 



s 1 



subject to 



1) q.(t) = A(i - 1/2) (t) (t^. - t) “x. (t)v'’ 



2) Qi(t^i) = 1 



3) Qi(t3-) = 0 



The solution procedure is initiated by absorbing the 
constraints into the objective function. Solving the first 
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constraint for x^(t) yields the following resource 
requirement function; 



Xi(t) = q.^(t)A ^(i - 1/2) ^^(t)(t^. - t) 

(3.4) 

After substituting into (3.3), the objective function 
becomes 



:di 



Min C ■ = 



i= y* tqJ(t)A ^(i-1/2) (t) (t^.-t) ■°‘^V''^e ^^]dt 



To simplify the solution procedure, a transformation that 
yields one state variable and one control variable is used 
with the control variable being the time rate of change of 
the state variable. Let 



Z(t) = A ^(i - 1/2) ^ ^(t)/(l - e) (3.6) 



This implies that 

z(t) = A~^(i - 1/2 )~'^V~''q.~^ (t)q(t) (3.7) 

Thus, Z(t) is the new state variable and z(t) , its time 
derivative, is the control variable. Substituting into 
(3.4) , we have an expression in terms of the new control 
variable, i.e.. 



26 



-ay 



(3.8) 



X. (t) = (t) (t^. - t) 



When substituted into (3.5) , this yields the following 
transformed problem: 



1 

Minimize 


tdi 

= J [z^(t)(t^. - t)‘“^e"P^]dt 


‘di 

= J I(z,t)dt 






"si 


tsi 


(3.9) 


subj ect 


to : 










1) 


Z(0) = 0 








2) 


Z(tdi) = A"^(i - 1/2)"^V‘V(1 - 


e) 




Since 


the 


intermediate function, I, does not 


depend 


explicity upon the state variable, the Euler equation 


is 
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3-Z 


Yz''-ht) (t^j - 


• 


(3.10) 


Solving 


for 


optimal z(t) yields 








z (t) 


- V 1^ i.YYa/(Y-l) pt/(Y-l) 

- K^(t^. - t) e 


• 


(3.11) 


Substituting 


this into (3.8) yields a 


solution 


to the 


optimal 


time 


path of resource use: 








x(t) 


_ K- ay/ ( y- 1) oYPt/ ( y- 

- (t^. - t) e 


1) 


(3.12) 



27 



This solution is only of transient interest since the value 
of constant is unknown. An optimal expression for x(t) 

in terms of the variables and parameters of the original 
problem is needed. To determine the constant of 
integration, notice that 



/ 



Z(t) = / K,(t^. - l)gPT/(Y 1)^3^ + 



SI 



(3.13) 

As this is not an easy integral to evaluate, another trans- 
formation is useful to simplify the solution. Let 



w = - t)/(y - 1), then (t^. - t) = w(y - l)/p and 

T = t^^ - w(y - l)/p. The Jacobian of the transformation is 
J = dx/dw = -(y - l)/p. Substituting into (3.13) , vie have 



Z = 






„(y . 1 ) 1/(Y-1) 



t " P I 



Jdw (3.14) 



■/ 



1 ' p ' 

(3.15) 



Let K, = -K, [ 

3 I p 



(Y - 1) (l“/(Y-l)} + l Pt^i/(Y-1) 



and we have 



Z = / Kjw''”/ e-"dw 



(3.16) 
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Now, the limits of integration must be determined. 



When T - t, w = P(t( 3 i - t)/(Y - 1); when t = t^^, and 

w = -1). It now follows that 



Z = 



/ 



(y-1) 



K^w 



ya/ (y-1) 



~w, 
e dw 



^(^di-^si) 
(Y-1) 



(3.17) 



P(tdi-t) 

(Y-1) 

/ rr Y O/ ( Y -1 ) -W , 

K^w' ' ' ' ' e dw 

0 

These last two expressions can be recognized as incomplete 

gamma functions; the one on the right is always constant 

since t does not appear as a variable. We now have 

Z(u) = -K3{r(p(t^. - tg.)/(Y - 1), (y<x/(y - D) + 1] 

- r[y,(Ya/(Y - D) + 1} + (3.19) 

where y = P(t^j^ - t)/(Y - 1). From the constraints for 

equation (3.9) , we know that Z(0) = 0. It thus follows that 
= 0 so it can be removed from (3.19). Also let 






-/ 



(y-1) 



rr Ya/(Y-1) -W, 

K3W ' ' ' ' ' e dw 



(3.18) 
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■K 3 = A ^(i - 1/2) '^(1 - e) > 



{yci/{y - D) + 1] 



(3.20) 



so that Z also satisfies the final condition: 



Z(t^i) = A"^(i - l/2)"'^V(t^i)"V(l - O 



Also note that 

.,t) = ^ = K 3 (p -^1^) e (- 

(3.21) 

After substituting for K^, the following expression is 
obtained : 



z(t) = A ^(i-l/2)"V '’(1-c) ^ [p (t^ .-tg. )/(y- 1) / (Ya/(Y-1) )+l] 



P(t^i - t) Yc*/(y- 1) _p(t t)/(Y-l) p 

t (Y - 1) ^ (3*22) 



This formulation for optimum z(t) together with (3.11) 
provides a direct solution for K^: 



Kj = A"'-(i-l/2)"*V‘'’(l-t) ^1 p , (YO/(Y-l) )+ll 



<^T> 



(Ya/(Y-1))+1 -Pt^i/(Y-1) 



(3 . 23) 
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Substitution for in (3.12) yields the following optimum 

time path of resource use: 



x.(t) = B(i 



1 / 2 )-^^-^'' 



r ^ [o (t^.-tg. )/(y- 1) , (Ya/(Y-1) ) + 1] 




-YP /(y-1) 



(3.24) 



e 



where 



B = a"^ (i_e)-Y[p/(Y-l)] 



(OY^/ (y“1) ) +Y 



This is the optimal time path of resource use on any 
ai rf rame . 

Since airframe manufacturing data is generally recorded 
on a monthly or quarterly basis, the quantity of interest is 
the total resource used over the appropriate period. The 
data available for this study are direct labor hours per 
month so, letting T^ and T 2 represent the beginning and 
ending dates for a monthly period, the appropriate 
expression for airframe i is: 




X. (t)dt 



(3.25) 



T 



1 
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Substituting for x^(t) using equation (3.12), the integral 
becomes 

T 2 

Xi(T2) = J (t^ .-t) 

"^1 

(3.26) 

Let y = YP ( --t) / ( Y-1) , then y(y-1)/yp = (t^^j^-t) and t = 

tdi - y(y-1)/yp. Thus, when t = ? 2 / Y = Y P ( t^ . -? 2 ) / (y - 1 ) 
and when t = T^, y = Y p ( / ( Y-1 ) . It now follows that; 



ypCt^i-Tj) 



Xi(T2)-Xj(Ti> = 



/ 



(Y-1) 



1 YP 



YP(tdi-T,) 

(Y-1) 



(3 . 27) 



where J = dt/dy = -(y-1)/yp» 

This can be further simplified: 



Y0(t„i-T2) 

(Y-1) 



Xi(T2>-Xi(Tj)= 



(Y-1) „-Y 



J 

YP(tai-Ti) 

(Y-1) 



-) 



e " dy 

(3.28) 




y^y/ (y-1) 



e ^dy 



(3.29) 
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where D 



Y Y-1 (“Tf/ (Y-1) ) +1 YPt,./(Y-l) 

= ^ 



Xi (T2) -X. (T^) = -D 




YP(t^i-T2) 
(Y-1) 



y[ (“y/(y-D )+l]-l _ 



YP(t^i-Ti) 

r (y-1) 



y[(aY/(Y-l))+l]-l 

(3.30) 



In this form, the incomplete gamma function is again 
recognizable and we have 



Xi<T 2 > - X;<T^) = 



' -“I''' -TT^T) 



f ( “Y/ (y-1) ) + 1] - 



-r [ 



YP(t^i-Ti) 

(y-1) 



(aY/(Y-l) ) + 1 ] 



(3.31) 



Reversing the order of the last two terms we have 



YP(tdi-Ti) 



X.(T2) - X.(Tj^) = r[ , (aY/(Y-D) + H - 



r [ 



YP(t^i-T2) 

(Y-1) 



, (ctY/(Y-l) ) + 1], 



(3.32) 
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Substituting for D and yields 

Xi (T 2 >-Xi (Ti) = A"^ (i-l/2)"^^V”^'' (1-e)"^ 
r"^ [P (t^.-tg. )/(Y-l) , (Ya/(Y-1) )+l] 

(aY/(Y-l))+l YPt,V(Y-l) 

((y-D/yp) e (3.33) 

This can be simplified to 

Yi (T 2 )-Yi (Tf) = 6Q(i-l/2)"^^V“^'’ (Tj^,T 2 )r"^ [p (t^.-tg.)/(Y-l) , 63 ^] 



{r [ 



YP(t^i-Ti) 

Y-1 



] - r[ 



YP(t^i-T2> 

Y-1 



B] } 



(3.34) 



where 6^ = A ^(1 - e) (“y/(y 1)) 1 

(p/(Y_i) )Y [ (Yce/(Y-1) )+1 ]-(cy/(y- 1) )+l] 

and = (yo</(y- 1)) + 1* This equation quantifies the 

amount of the variable resource required per month in the 
production of airframe i. Note that this expression is 
consistent with the assumptions made concerning the 
production cost drivers. This resource requirement 
equation, together with the anticipated range of values for 
each parameter (y>^ 1, 0£6£l, 0_<a_<l, 

V < 0) , depicts resource usage per month on each airframe to 
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be indirectly related to the airframe sequence number and 
the dates when work was started and completed on the 
airframe (representative of the effects of learning) and 
indirectly related to the number of airframes under con- 
struction during the time period (representative of the 
effects of production rate) . 

Because of the nature of the data, it is impossible to 
observe the monthly amounts of resources devoted to any 
particular airframe. As reported in the data set, what is 
observable is direct man-hours per job order per month. 
This means that the observed quantity is 

'"J “"J 

2 [X. (?2) -X. (T^) ] = SQ(i-l/2)”^^V^^ (T^,T2) 

YP(tdi-T.) YP(t,.-T2) 

r ^ [p (t^ ■ -tg . )/(Y-i) ,63^] {r [ (y-1) '®i^ ■ (Y-il 

( 3 . 35 ) 

where F, and L, are the sequence numbers of the first and 
last airframes in Job Order J. 

This functional form represents the aggregate of 
resource usage per month in the production of all airframes 
in Job Order J and facilitates the generation of a time path 
of resource use. Using monthly labor hours and airframe 
delivery dates as the variables in the equation, nonlinear 
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regression using Marquardt's compromise [Ref. 17] is used to 
generate estimates for the parameters of equation (3.35) . 
When equation (3.35) has been fully parameterized with these 



estimates, substitution of job order release and deli\ 
dates and airframe sequence numbers allows prediction 
monthly labor hour requirements. The following chapters 
devoted to reporting the empirical results of the model 
assessing how well it explains the data. 



er y 
of 
are 
and 
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IV. THE DATA 



Based on both its availability and suitability for 
evaluating the model's potential as a tool for a program 
manager, cost data for the F-4 Phantom II was used in this 
analysis. The F-4 was designed and built by the McDonnell 
Aircraft Company of St. Louis, Missouri in response to the 
Navy's requirements for a carrier-based aircraft capable of 
fleet air defense. First flown in May, 1958, the F-4 became 
the first Mach 2-plus carrier-based fighter by incorporating 
numerous advanced designs and technologies. So impressive 
was its performance that later versions of the F-4 were 
purchased by both the U.S. Air Force and Marine Corps as 
well as over ten foreign air forces. In total, thirteen 
versions of the F-4 were produced with more than 4000 
aircraft delivered between 1958 and 1979. 

Of immediate concern with such an extensive and 
heterogeneous data base are the interrelationships between 
different versions of the aircraft. In particular, the 
extent of learning and the effects on the production rate 
parameter are somewhat obscured by having multiple versions 
of the aircraft under simultaneous production. While not 
discounting this potential problem, the necessity for 
resolving it is relieved by evaluating the model's 
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usefulness from the perspective of a Navy program manager 
who quite possibly could encounter this same problem in his 
use of • the model. One possible scenario would be where a 
program manager has cost data on an early version of an 
airframe purchased by the Navy and must develop a funding 
profile for buying an improved version based on the lot 
release and delivery dates specified in the manufacturer's 
production contract. As it would not be unusual for the 
early version or the improved version or both to be produced 
concurrently with other contracts, it would be useful to 
know the model's usefulness in this situation. 

The F-4 program provides a particularly well suited data 
base for accomplishing the proposed objective. The Navy 
purchased two versions of the F-4, the F-4B and the F-4J. 
In all, 660 F-4B airframes were accepted be'tween February, 
1958 and January, 1967 and 552 F-4J airframes were accepted 
between October, 1964 and December, 1971. The F-4B cost 
data will be used as the data base for estimating the 
model's parameters. These data were drawn from two sources. 
Direct man hours per month for each job order of F-4 
production are reported in the McDonnell Aircraft Company's 
document "Report 7290, F-4 Cost Data" [Ref. 18]. Aircraft 
acceptance dates ivere obtained from the OASD publication 
"Acceptance Rates and Tooling Capacity for Selected Military 
Aircraft" [Ref. 19] and used in lieu of delivery dates which 
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were not available. Since the exact acceptance dates were 
unavailable, for purposes of research, airframe acceptances 
were assumed to be distributed uniformly over the month of 
acceptance . 

Several problems were encountered in compiling the data 
to use with the model. The first job order of the F-4B 
production run accumulated in excess of 172,000 labor hours 
before its reported release date. These labor hours were 
reported as a lump-sum which cannot be satisfactorily 
explained. As a result, these labor hours were not used in 
the model; the data which were used begin v/ith the month 
that this first job order was released for production. 

Each job order also had a small number of manhours 
expended in months after all the airframes within that job 
order had been accepted. These hours were" aggregated and 
then distributed evenly throughout the preceding months of 
the job order. 

With these adjustments, 233 observations of labor hours 
recorded over 108 months in the production of 660 airframes 
remained. These observations, together with the average 
number of airframes under production per month, form the 
data for study as reported in the appendix. 
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V. EMPIRICAL RESULTS 



As formulated in Chapter III, the proposed model is that 
manhours per job order per month are equal to 



[X. (T2)-X. (T^) ] 



i=F 



= E 



i=F. 



(i-l/2) ''*V (Tj^.Tj) 






rp(t^j-Ti) 



.6^1 - r [ 



YP(t^i-T2) 



(y-1T~ * 



The regression estimates of the model's parameters are 
presented in Table I. 



TABLE I 

PARAMETER ESTIMATES 



Parameter 


Estimate 


Standard 




2.509 


0.665 


1 — 1 
QQ. 


3.031 


0.325 


6 


0.462 


0.024 


Y 


1.006 


0.001 


V 


-0.200 


0.067 
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All parameter estimates are significantly different from 
zero and consistent with apriori assumptions. As one of the 
model's key assumptions is the existence of an inverse 
relationship between production rate and unit costs, 
attention is first directed to the estimated value for Y. 
The estimated value of 1.006 indicates the existence of 
decreasing returns to labor inputs. That is, increases in 
the rate of production will increase labor requirements (and 
hence unit costs) . The estimated value of 6 corresponds to 
a 73 per cent learning curve. While this percentage may be 
slightly low by industry standards, it is not all that 
surprising due to the concurrent production of other models 
of the F-4. Some learning in the production of these other 
models undoubtedly benefited the F-4B program and 
contributed to the observed 73 per cent learning curve. The 
small negative value for v confirms expectations about the 
effects of facility size and crowding. 6^ is a scaling 
parameter and appears consistent with earlier studies. The 
estimated values of 6^ implies o and e values of 0.01 which, 
while small, are within the range of apriori assumptions. 

Graphical analysis demonstrates the time path of 
resource use generated by the model to be a reasonable one. 
Figure 2 illustrates the time path of labor use predicted by 
the model and the actual labor hours used. Figure 3 
compares a 90 per cent confidence interval for the predicted 
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-4B LABOR HOURS. OBSERVED VS PREDICTED 
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90 PER CENT CONFIDENCE INTERVAL FOR PREDICTED VALUES 
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labor hours with the observed labor hours. The model does 

2 

fit the data quite well as evidenced by the R value of .76 
obtained by squaring the XY correlation coefficient reported 
in Figure 4. This figure shows that plotting the observed 
values against the predicted values yields approximately a 
45 degree line which further illustrates the model's success 
in explaining the variability of the data. Relatively large 
and unexplained deviations between the observed and 
predicted values are apparent during roughly the first and 
last thirds of the production run (approximately months 
19-31 and 69-96). Disassembling Figure 2 into individual 
job orders (Figures 5-13) reveals that most of the deviation 
noted during the first third of the production run can be 
attributed to Job Order 692. This job order is charac- 
terized by the predicted time path lagging' several months 
behind the observed. A factor of unknown significance is 
that this was the first sizable job order to be released. 
The second area of deviation corresponds with a very large 
release of another model of the F-4 which may have had 
unpredictable effects on the regression output. 

Analysis of the residuals shows them to be essentially 
normal with no extreme outliers noticeable. Residual 
analysis was conducted on two levels — the 233 observations 
available before aggregating the nine job orders and the 108 
observations formed by combining the job orders into the 
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SCAHER PLOT OF OBSERVED VS PREDICTED LABOR HOURS 
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Figure 4 . Scatter Plot of Observed vs Predicted Labor Hours 



JOB ORDER 687, OBSERVED VS PREDICTED 
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MONTH OF OBSERVATION 



JOB ORDER 692, OBSERVED VS PREDICTED 
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MONTH OF OBSERVATION 

Figure 6. Job Order 692, Observed vs Predicted 



JOB ORDER 701, OBSERVED VS PREDICTED 
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MONTH OF OBSERVATION 



JOB ORDER 713. OBSERVED VS PREDICTED 
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MONTH OF OBSERVATION 



JOB ORDER 720. OBSERVED VS PREDICTED 
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JOB ORDER 726, OBSERVED VS PREDICTED 
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MONTH OF OBSERVATION 



JOB ORDER 731, OBSERVED VS PREDICTED 
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MONTH OF OBSERVATION 



JOB ORDER 736. OBSERVED VS PREDICTED 
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JOB ORDER 746. OBSERVED VS FITTED 
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MONTH OF OBSERVATION 



time path shown in Figure 2. Figures 14-18 depict the 
larger set of residuals. These residuals generally appear 
random, and symmetric with a sample mean of 0.002 and some 
positive skewness evident. When plotted against the 
dependent variable, the sign and magnitude of the residuals 
do exhibit a slight positive relationship with the observed 
amount of labor hours. The statistical table of Figure 18 
contains several goodness of fit statistics which generally 
do not contradict, at a .05 significance level, a hypothesis 
of normally distributed residuals. To test for 
heterosked ast ici ty , the residuals were divided in half and a 
hypothesis of equal variances was tested using an F test 
(see Mood, Graybill, and Boes [Ref. 20]). An F statistic of 
1.19 (associated significance level = 0.34) was calculated. 
This supports the conclusion that the variance of the 
residuals is constant. This conclusion is further supported 
by the lack of any noticeable pattern upon visual inspection 
of the residuals in Figures 14-17. 

Similar analysis of the smaller set of 108 residuals 
shows that they also are fairly normal with a sample mean of 
0.004. These residuals are not as symmetric as the larger 
set as evidenced by the higher measure of skewness reported 
in the statistical table of Figure 21. While these 
residuals are perhaps not as nearly normal in appearance as 
the larger set, a hypothesis of normally distributed 
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-4B RESIDUALS VS MONTH OF OBSERVATION 
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MONTH OF OBSERVATION 



-4B RESIDUALS VS OBSERVED LABOR HOURS 
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Figure 15. F-4B Residuals vs Observed Labor Hours 



RESIDUALS VS PRODUCTION RATE 
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RESIDUALS VS CUMULATIVE NUMBER PRODUCED 
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F-4B RESIDUALS FITTED TO A NORMAL DISTRIBUTION 

NORMAL DENSITY FUNCTION. N-233 NORMAL CUMULATIVE DISTRIBUTION FUNCTION. N-233 



I 




60 



residuals is again generally supported at the .05 
significance level by the goodness of fit statistics. In 
this case, the test for he t er osk ed as t i c i t y yielded an 
F-statistic of 1.55 (associated significance level = 0.11) 

which again supports a conclusion of constant variance. In 
this case, however, there appears to be a cyclical pattern 
in the residuals that is most apparent in Figure 19. 

The cyclical pattern noted above suggests that a test 
for autocorrelation is in order. In contrast to the larger 
set, a test for autocorrelation in the aggregated residuals 
is meaningful since they are derived from an entirely 
sequential time series. The Durbin-Watson test (see Judge 
et . al . [Ref. 21]) was used to test for first order 
autocorrelat ion in the aggregated set of 108 residuals as 
well as in each of the individual job orders. Considering 
the four production cost drivers as the independent 
variables and including a constant term (i.e., K = 5) , a 

null hypothesis of no autocorrelation was tested against an 
alternative hypothesis of positive autocorrelation. As 
shown in Table II, the Durbin-Watson test statistic was, 
with but two exceptions, less than the lower critical value, 
d^, and thus indicative of a positive autocorrelation 
problem. Since a nonlinear model was used, transformations 
of the variables to eliminate this problem are inappropriate 
and the autocorrelation must therefore be included in this 
model . 
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OBSERVED LABOR HOURS -f 100,000 



F-4B RESIDUALS FITTED TO A NORMAL DISTRIBUTION 

NORMAL OENSITr FUNCTION, N-109 NORMAL CUMUUTIVE DISTRIOUTION FUNCTION. N-108 
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TABLE II 



AUTOCORRELATION TEST RESULTS 

Durbin-Watson Degrees of dy 

Data Set Statistic Freedom (5% Significance Level) 



all job orders 
combined 


0.373 


108 


1.592,1.758 (approx) 


Job 


Order 


687 


0.190 


34 


1.208,1.728 


Job 


Order 


692 


0.163 


30 


1.143,1.739 


Job 


Order 


701 


0.242 


29 


1.124,1.743 


Job 


Order 


713 


0.521 


22 


0.958,1.797 


Job 


Order 


720 


0.436 


25 


1.038,1.767 


Job 


Order 


726 


1.643 


27 


1.084,1.753 


Job 


Order 


731 


0.219 


26 


1.062,1.759 


Job 


Order 


736 


0.368 


27 


1.084,1.753 


Job 


Order 


746 


0.944 


13 


0.574,2.094 
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VI. CONCLUSION 



The objective of the research conducted by Womer and 
Gulledge was to incorporate economic theory into an airframe 
cost estimation model that is estimated from historical data 
and is sensitive to exogenous production schedule changes. 
Examination of the Womer-Gulledge model using F-4B cost data 
indicates their approach to be a valid and promising one. 
The results attained with their model are certainly 
comparable to those of other cost estimation models, and, at 
the same time, consistent with economic theory that other 
models have ignored. This conformity with accepted economic 
theory greatly enhances the model's usefulness to Navy 
management in planning and funding ‘its aircraft 
acquisitions. The model has demonstrated a sensitivity to 
production rate changes that should enable a program manager 
to predict the effects of production schedule changes and to 
formulate and implement the most cost effective production 
schedule available. 

Of particular significance in evaluating the model's 
potential applications is the consistency of its parameters 
across quite different airframe production programs. The 
parameter estimates reported in this thesis are quite 
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similar to those attained by Womer and Gulledge in their 
studies of the C-141, F-102, and F-5/T-38 [Ref. 16]. By 

modifying the scaling parameter, to a level appropriate 

for the airframe of interest, the model can be adapted to 
plan the time path of resource usage for a new airframe 
before any cost data have been generated for the program. 
As actual production cost data become available, the 
preliminary cost estimates can be updated and refined using 
a Bayesian updating technique described by Womer and 
Gulledge [Ref. 16]. 

While the model does perform quite well and has readily 
apparent applications, it is not without flaws. One flaw is 
that the model allows only limited interaction among 
airframes. By assuming that all airframes in a job order 
are released simultaneously, the model does' not allow work 
on an airframe to start later than the lot release date. 
This may create an artificially high production rate and 
understate the effects of learning over time. A second flaw 
is that the model includes no cost penalty for the hiring or 
firing of labor. Therefore, the model may predict that the 
work force should rise, then decline, and then rise again 
v/hen hiring/firing costs may render a more moderate sized 
work force more cost effective during the relatively brief 
peaks and slumps in labor requirements. Another flaw of the 
model is the absence of any mechanism to adjust for the 
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autocorrelation noted in Chapter V. The model should be 
modified to compensate for the temporal relationship in the 
data. 

While not a flaw of the model itself, a potential 
problem in its implementation is data collection. The data 
typically collected is cumulative labor hours per lot of 
airframes. Without prior planning, it may be difficult to 
acquire the data to estimate the model accurately since the 
model calls for cost information on a per airframe basis. 
In this study, the model was modified slightly with unknown 
effects on accuracy since the data were aggregated on a job 
order level. 

Despite these imperfections, the model should be 
considered a valuable tool for the decisionmaker. Owing to 
the intricacies and inexactness of the science of cost 
estimation, any and all such tools should be used to improve 
the decisionmaker's awareness of the factors that can 
affect a program's costs. As production scheduling does 
matter as a determinant of program cost, the model may 
enable decisionmakers to better understand the implications 
of funding cuts, stretchouts, and altered delivery schedules 
and, therefore, to make better decisions. 
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APPENDIX: F-43 DATA BASE 

Data for each of the nine F-43 job orders are listed with 
one line of data entered for each month during which work 
occurred on a job order. Each line contains 

L T2 D W N H T1 • 

where L = labor (in 100,000 hours) for the job order this month 
T2 = end of time period 

D = # of airframes delivered prior to this job order 
W = time period when work began on this job order 
N = sequence # of the last airframe in the job order 
H = average # of airframes in house during this period 
T1 = start of time period 

After these lines, the delivery dates for each of the airframes 
in the job order are listed. 
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28.0 
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27.0 


15.0 


16.000 
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.0 


16 . 


,0 


38 . 


0 . 
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.0 


38 . 


2 , 


.11521 


57 . 


.0 


16 . 
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0.02965 48.0 


40.0 
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46.0 


112.0 


101.000 


50.0 


1.00236 52.0 


40.0 
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112.0 
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46.0 
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